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Abstract 

In this letter, we improve the results in [5] by relaxing the symmetry assumption and also taking 
the noise term into account. The author examines two discrete-time autonomous linear systems whose 
motivation comes from a neural network point of view in [5]. Here, we examine the following discrete- 
time autonomous linear system: x(fc + 1) = Ax(fc) +b where A is any real square matrix with linearly 
independent eigenvectors whose largest eigenvalue is real and its norm is larger than 1, and vector b is 
constant. Using the same "SIR" ("Signal"-to-"Interference"-Ratio) concept as in [4] and [5], we show 
that the ultimate "SIR" is equal to j — a "_ a .. < i = 1» 2, . . . , N, where N is the number of states, an 
is the diagonal elements of matrix A, and X max is the (single or multiple) eigenvalue with maximum 
norm. 

Index Terms 

Autonomous Discrete-Time Linear Systems, Signal to Interference Ratio (SIR). 

I. Introduction 

This letter improves so-called "SIR" results in [5] where the author analyzes two discrete-time 
autonomous linear systems whose motivation comes from a neural network point of view. In [3] 
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a dynamic-system-version of SIR ("Signal"-to-"Interference" Ratio) concept is introduced. Let's 
first present the definition of the SIR in [4]. 

The SIR is an important entity in commucations engineering which indicates the quality of 
a link between a transmitter and a receiver in a multi transmitter-receiver environment (see e.g. 
[1], among many others). For example, let N represent the number of transmitters and receivers 
using the same channel. Then the received SIR at receiver i is given by (see e.g. [1]) 

gjfr(fc) = 7i(*0 = 9 N uMk) — , i — 1, . . . ,N (1) 

^ + E j =i, j ^i9ijPj{k) 

where Pi(k) is the transmission power of transmitter % at time step k, gij is the link gain 
from transmitter j to receiver % (e.g. in case of cellular radio systems, involves path loss, 
shadowing, etc) and Vi represents the receiver noise at receiver i. Typically, in cellular radio 
systems, every transmitter tries to optimize its power Pi(k) such that the received SIR(k) (i.e., 
7i(fc)) in eq.(l) is kept at a target SIR value, 7* 3< . 

The author defines the following dynamic-system-version of the "Signal-to-Interference-Ratio 
(SIR)", denoted by 6i(k), by rewriting the eq.(l) with neural networks terminology in [4] and 
[5]: 

m= h *N iXi{k) 7TT> i = l,...,N (2) 

where 9i(k) is the defined fictitious "SIR" at time step k, Xi(k) is the state of the z'th neuron, 
a„ is the feedback coefficient from its state to its input layer, is the weight from the state of 
the j'th neuron to the input of the j'th neuron, and bi is constant. 

In this paper, we improve the results in [5] where the author examines the ultimate SIR in the 
following two discrete-time autonomous linear systems whose motivation comes from a neural 
network point of view. 

1) The discretized autonomous linear system: 

x(fc + 1) = (I + a(—rl + W))x(fc) (3) 

which is obtained by discretizing the autonomous continuous-time linear system in [4] 
using Euler method; where I is the identity matrix, r is a positive real number, and a > 
is the step size. 
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2) A more general linear system with symmetric weight matrix 

x(Jfe + 1) = (-pi + W)x(ife) (4) 

where I is the identity matrix, p is a positive real number, and (—pi + W) is the system 
matrix. 

In [5], the above linear systems with symmetric matrices and with zero noise term are 
examined. In this paper, we relax these two conditions, and examine the SIR in the general 
discrete-time autonomous linear system in eq.(5) where the weight matrix A e R NxN is any 
real matrix whose largest (single or multiple) eigenvalue is real and its norm is larger than 1 . 

It's well-known that in the system of eq.(5), the eigenvalues of the weight (system) matrix 
solely determine the stability of the system. If the spectral radius of the matrix is larger than 1, 
then the system is unstable. The spectral radius of an TV x N matrix is equal to max-dA;]}^ 
where A, is the eigenvalues of the matrix. In this paper, we examine the linear systems with 
system matrices whose spectral radius is larger than 1 . 

The paper is organized as follows: The results for system eq.(5) are presented in section II. 
Section III presents some simple simulation results, followed by the conclusions in Section IV. 

II. "SIR" in Discrete-Time Autonomous Linear Networks 
In this paper, we examine the SIR in the following autonomous linear system 

x(k + 1) = Ax(fc) + b (5) 

where x(fc) G R Nxl is state vector at step k, A e R NxN is any real square matrix with 
linearly independent eigenvectors whose largest eigenvalue is real and its norm is larger than 1, 
and vector b is constant. In what follows, we present the main result of this paper: 

Proposition: 

In the discrete-time linear system of eq.(5), if the matrix A has linearly independent eigen- 
vectors, and if the (single or multiple) eigenvalue with the greatest norm is real and its norm is 
greater than 1, then the defined "SIR" (9i(k)) in eq.(2) for any state i converges to the following 
constant within a finite step number denoted as k T for almost any initial vector x(0). 



March 19, 2009 



DRAFT 



103 



9i(k > for) = aii _ , t = l,2,. ..,N (6) 

where A ma:E is the (single or multiple) eigenvalue with maximum norm and an is the diagonal 
elements of A. 
Proof: 
From eq.(5), 

fc-i 

x(fo) = A fe x(0) + AJ ' b (7) 

where x(0) shows the initial state vector at step zero. It's well known that any real square 
matrix A whose eigenvectors are linear independent can be decomposed into (see e.g. [2]) 



A = VD A V 1 (8) 
A = VD A U (9) 

where the matrix V has the eigenvectors in its columns, and matrix Da has the eigenvalues 
in its diagonal, and where 



U = V 



-l 



(10) 



The matrices in eq.(9) are given as 
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From eq.(8), (9) and (11) 







A AT 
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From eq.(7) and (13), 
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N N k-l 

= E ANiuf x(0) + EE Ajviufb + b 

i=l 1=1 j'=l 

From the denominator of eq.(2), we define the interference vector, J (A;), as follows 



(14) 



J(Jfe) = (A-D A )x(A;) + b 



where 



Da = 



a n ... 
Oii ... 

... 







0-NN 



NxN 



Defining fj, u>i = ufx(O) and fx bji = ufb, eq.(14) is rewritten as 



N N k-l 

x (» = E A ^ Vi^u.i + E E X i V iVb,i + b 
i=l i=l j=l 



(15) 



(16) 



(17) 



Let's show the (single or multiple) eigenvalue whose norm is the greatest among the eigen- 
values as \ m ax- Then, in eq.(17), the term related to the A maa; , whose norm is greater than 
1 by assumption, dominates the sum. This is because a relatively small increase in Xj causes 
exponential increase as time step evolves, which is shown in the following: Let's define the 
following ratio 



K{k) 



(18) 



(A, + AX) k 

where AA represents the decrease (increase). The n(k) in eq.(18) is plotted in Figure 2 in 
[5] for some different AA values. The Figure 2 in [5] implies that the term related to the X max 
dominate the sum in eq.(17). So, there exists a finite step number k T such that 



k-l 



X 0) = X max V m ^ m + Y X inax V mVb,m, k > k T 

3=1 

where v m is the eigenvalue corresponding to the X max . From eq.(7), (12) and (15) 



(19) 
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J(fc) = VD A Ux(A;) - D A x(A;) + b (20) 



k-l 



= VD$ +1 Ux(0) + E VD{ +1 Ub + VD A Ub - D A x(A;) + b (21) 

i=i 

Using eq.(14) and (15) 

N N k-l 

m = E A- +1 v,uf x(0) + E E A| +1 v,uf b + VDUb - D A x(A;) + b (22) 

i=l i=l j=l 

As in the steps from eq.(17) to eq.(19), we see in eq.(22) that the term related to the maximum 
eigenvalue X max in magnitude, (which is greater than 1 by assumption), dominates the sum in 
(22). In other words, comparing eq.(17), (19) and (22), we obtain that 

k—l 

m = X^lvm^m + E Aj^vwv, - D A x(fc), k > k T (23) 

3=1 

where fi u , m = u^x(0) and fib, m = u^ t b as defined in eq.(19). Using eq.(19) in (23) 

J(fc) = {A ma J - D A }x(A;), k > k T (24) 

In eq.(23), we assume that // Ujm ^ 0, i.e., x(0) is not completely perpendicular to u m defined 
above. That's why we say "for "almost" any initial vector" in the proposition phrase. However, 
this is something easy to check in advance. If it is the case, then this can easily be overcome 
by introducing a small random number to x(0) so that it's not completely perpendicular to the 
u m . So, from eq.(24), 

We conclude from eq.(25) and from the "SIR" definition in eq.(2) that 

*(*> = ^TW^hm = r-^- k - kT ' i = 1 -- N - < 26 > 

where X max is the (single or multiple) eigenvalue of A with the maximum norm and k T 
shows the finite time constant during which the X max become dominant in the sum of (17), 
which completes the proof. 
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Definition: State- specific ultimate SIR value: In proposition 1, we showed that the SIR in (2) 
for every state in the autonomous discrete-time linear networks in eq.(5) converges to a constant 
value as step number goes to infinity. We call this converged constant value as "ultimate SIR" 
and denote as 9f\ i = 1, 2, . . . , N. 

Does the result in the proposition above have any practical meanings? Our answer is yes. In [4] 
and [5], we present some (continuous-time and discrete-time) networks which are stabilized by 
the ultimate SIR as applied to the binary associative memory tasks as compared to the traditional 
Hopfield Neural Networks. So, similar to the networks in [5], the proposed autonomous network 
here is 

x(fc + l) = Ax(k)6(6(k) - 9 ult ) (27) 
y(k) = sign{*{k)) (28) 

where I is the identity matrix, A is the system matrix, 9 ult = \9'f t 9'f i . . . 9^ t ] T ', and 9(k) = 
[9 1 (k)9 2 (k) . . . 9 N (k)} T is the SIR vector at step k whose elements are given by eq.(2), the 
function S(-) gives if and only if its argument vector is equal to zero vector, and gives 1 
otherwise, and y(k) is the output of the network. 

The proof of the proposition above shows that in the linear network of (5), the defined SIR 
in eq.(2) for state i converges to the constant SIR value in eq. (6), for any initial condition 
x(0) within a finite step number k T . It's seen that the linear networks of eq.(5) is nothing but 
the underlying network of the proposed network without the S(-) function. Since the "SIR" in 
eq.(2) exponentially approaches to the constant Ultimate "SIR" in eq.(6), the delta function will 
stop the exponential increase once 9{k) = 9 ult , at which the system output reach its steady 
state response. So, the the presented network is stable. Furthermore, we note that the proposed 
networks in [4] and [5] which have been applied to the binary associative memory systems are 
special cases of the proposed network in eq.(27) and (28). 

III. Simulation Results 

In this section, we borrow the simple simulation examples in [5] with 8 and 16 neurons. We 
plot some samples of the evolution of the SIRs with respest to step number in the system of 
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Fig. 1. A sample evolution of SIR(k) with respect to time step for 8-dimensional system with (a) the weight matrix in [5] 
when the initial vector is 2-Hamming distance away from desired vector, , and (b) random weight matrix. 



[5] whose weight matrix is presented in [5] as well as in the system of eq.(5) whose weight 
matrix is chosen randomly for illustration purpose. Figure l.a shows a sample of SIR evolution 
in the 8-neuron case in the example 1 of [5], for initial condition [—111 — 1 — 1 — 1 — 1 — 1] 
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while the desired vector is [1111 — 1 — 1 — 1 — 1] (Hamming distance is 2). Figure l.b shows 
a sample evolution of SIR in case of the system in eq.(5) with a random weight matrix. Some 
sample evolution plots for the 16-neuron case are shown in Figure 2 for the system of eq.(5) 
with random weight matrix. The figures 1 and 2 show that the SIRs converge to their ultimate 
values and confirm the results in previous section. 

IV. Conclusions 

In this letter, we improve the SIR results in [5] by relaxing the symmetry assumption and 
taking also the noise term into account. We examine the following discrete-time autonomous 
linear system: x(fc+l) = Ax(fe)+b, where A is any real square matrix with linearly independent 
eigenvectors whose largest eigenvalue is real and its norm is larger than 1, and vector b is 
constant. Using the same "SIR" concept as in [4] and [5], we show that the ultimate "SIR" is 
equal to , a » — , i— 1, 2, . . . , N, where N is the number of states, X max is the eigenvalue with 
maximum norm and an is the diagonal elements of matrix A. 

Acknowledgments 

This work was supported in part by Academy of Finland and Research Foundation (Tukisaatio) 
of Helsinki University of Technology, Finland. 

References 

[1] T.S. Rappaport, Wireless Communications: Principles and Practice, Prentice-Hall, New York, 1996. 
[2] O. Bretscher, Linear Algebra with Applications, Prentice Hall, 2005. 

[3] Z. Uykan, "From Sigmoid Power Control Algorithm to Hopfield-like Neural Networks: "SIR" ("Signal"-to-"Interference"- 
Ratio)- Balancing Sigmoid-Based Networks- Part II: Discrete Time", submitted to IEEE Trans. Neural Networks, 
December, 2008. 

[4] Z. Uykan, "Ultimate "SIR" ("Signal"-to-"Interference"-Ratio) in Continuous-Time Autonomous Linear Networks with 
Symmetric Weight Matrices, and Its Use to "Stabilize" the Network as Applied to Binary Associative Memory Systems", 
submitted to IEEE Transactions on Circuits and Systems I, February, 2009. 

[5] Z. Uykan, " Analysis of "SIR" ("Signal"-to-"Interference"-Ratio) in Discrete-Time Autonomous Linear Networks with 
Symmetric Weight Matrices", submitted to IEEE Transactions on Circuits and Systems I, February, 2009. 



March 19, 2009 



DRAFT 



109 





5 








aT 




co 




-5 




1 




oT 




co 

-1 







IFUk) 


-0.02 


co 


-0.04 












cr 


-0.2 


CO 






-0.4 



20 



20 



20 



20 

time step k 



40 



CO 



40 



40 



40 



-0.02 
-0.04 
-0.06 

I 

0.5 


-0.5 




£ 2 
co 


0.2 

ST 

tr D 0.1 

co 





20 



20 



20 



20 

time step k 



40 



40 



40 



40 



(a) 




20 

time step k 



20 

time step k 



(b) 



Fig. 2. A sample evolution of SIR(k) with respect to time step for 16-dimensional system with random weight matrix, (a) 
SIRs from 1 to 8, (b) SIRs from 9 to 16. 
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